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SINGLE-LOOK  DETECTION  WITH  UNKNOWN  SIGNAL  STRENGTHS 


INTRODUCTION 

Detection  problems  involving  unknown  parameters  can  lead  to  large  error  probabilities.  An 
example  problem  illustrating  this  has  two  signals  of  unknown  strength  added  to  Gaussian  noise.  Let 
hypothesis  Hn  ( n  —  0,1,2)  designate  that  exactly  n  signals  are  present.  Mathematically,  the  problem 
with  equal  a  priori  probabilities  is  stated  as: 

p(h0)  =  purx)  =  p(h2)  =  1/3 

Ho-  rx  =  tt\ 
r 2  -  »2 

H\ :  rx  -  sx  +  nx 
r  2  =  n2 

or 
rx  = 

r2  =  52  +  «2 

H2\  rx  =  +  /Ji 

r2  =  s2  +  «2> 


where  rj  and  r2  are  received  signals,  nx  and  n2  are  noises,  and  sx  and  s2  are  signals  of  unknown 
strengths.  After  receiving  one  sample  each  of  rx  and  r2,  the  decision  problem  is  to  determine  how 
many  signals  are  present. 

The  classical  method  estimates  the  signal  strengths  from  the  received  voltages  under  each 
hypothesis,  places  these  signal  strengths  back  into  the  corresponding  pdf  (probability  density  function), 
and  chooses  the  number  of  signals  present  that  gives  the  minimum  error  probability.  This  method 
gives  a  2/3  error  probabality  for  any  combination  of  signal  strengths.  The  poor  performance  is  due  to 
having  only  a  single  observation  and  equal  a  priori  probabilities. 

A  detector  based  on  knowing  the  signal  values  provides  an  upper  limit  on  performance  and  is  the 
standard  to  which  other  methods  are  compared.  The  comparison  of  detector  performance  is  based  on 
the  total  probability  of  error.  The  spread  between  the  classical  and  the  known  signal  performance 
suggests  that  there  should  be  some  decision  procedures  having  error  probabilities  lying  between  them 
The  "known  signal"  rule  can  be  applied,  even  when  the  actual  signal  strengths  are  unknown,  where  a 
‘guess’  is  made  for  the  strengths.  This  rule  and  the  one  assuming  that  the  signals  are  uniformly 
distributed  between  two  limits  are  applied  to  this  problem.  Neyman-Pearson  type  tests  are  also 
developed  and  applied  to  this  problem.  The  Neyman-Pearson  tests  are  generalized  and  applied  to 
correlated  noise. 

PROBABILITY  DENSITY  FUNCTIONS 

Gaussian  noises  nx  and  n2  of  zero  mean  and  equal  variance  are  added  to  the  signals  sx  and  s2. 
For  most  of  the  work,  nx  and  n2  are  independent.  With  the  received  signals  normalized  to  the 
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noisestandard  deviation,  the  pdfs  for  //0,  Hu  and  H2  are  given  below.  Hn  is  the  hypotheses  that 
exactly  n  signals  are  present.  All  parameters  of  the  noise  are  assumed  to  be  known.  The  Gaussian 
noise  density  is 

n\  +  n2 

1 - ‘ - — 

Pn(nu  n2)  =  —  e  2  , 


and  the  probability  densities  for  the  received  signals  under  each  hypothesis  are 
Pr\H0  (rbr2)  =  1>  r2) 


r}  +  r\ 


27 r 


PAh^xSt)  ~  p(s\  ^  52  =  0)  pj  (r !  -  sj,  r2)  +  P(sx  =  0,  s2  ^  0)  p^(rur2  -  s2) 

=  \lhi^r  1  -  s\’rT)  +  y  Pjf(f\>r2  ~  S2 ) 


1  ,  (rr»i)2  +  r$  ^  ^  r  f+(r2- s2)2 

=  —  —  e  2  +  —  —  p  2 

2  2tt  2  2tt 


and 


Pr\H2^r Uri)  —  Py;(r l  —  51.  r2  ~  st) 


1 

2n 


(ri-st)2  +  (r2  -  s2)2 


The  probability  density  function  of  jointly  Gaussian  correlated  noise  of  equal  variances  and  correlation 
coefficient  p  is  given  by 


v/j j  ~2p  +  nf) 


2(1— p2) 


Px(ni',t2)  27T  ( 1 — p2)  1/2  ^ 

The  probability  density  of  the  received  signals  under  each  hypothesis  is  modified  accordingly. 


MINIMUM  PROBABILITY  OF  ERROR 


The  decision  of  whether  H0,  Hu  or  H2  has  occurred  is  made  after  looking  at  the  received  signals 
rx  and  r2  and  using  the  known  a  priori  probabilities.  The  minimum  probability  of  error  occurs  when 
the  probability  of  being  correct  is  a  maximum.  The  decision  rule  is 

max  P(Hj  |  observe  7)  — ♦  choose  H, 

H, 

or  equivalently. 


max  P(Hj )  py <H  (rbr2)  — »  choose  Ht . 

If  P(Hj)  P7\ff(r\,r2)  is  compared  with  P (Hj) p^H  (r^,r2) ,  then  the  hypothesis  having  the  smallest  value 

can  never  be  the  one  giving  the  maximum  value  (at  least,  it  would  be  rejected  in  favor  of  the 
hypothesis  having  the  larger  value  in  this  test).  Thus,  the  result  of  conducting  the  maximization  opera¬ 
tion  is  equivalent  to  choosing  the  hypothesis  that  satisfies  a  set  of  binary  tests  (expressed  in  the  nega¬ 
tive  of  each  hypothesis)  [1,  pp.  48-50],  For  the  case  of  three  hypotheses,  this  set  of  tests  is: 

H0  and  H\.  P(H0)p^Ho(7)  <  P{H{)  pr\Hp!)  — 1 •  not  H0 ,  else  not  #j , 

Ho  a°d  H2:  PiH^)pT^HJJ)  <  P(H2)  —  not  H0,  else  not  H2,  and 

Hi  and  H2 :  <  P(H2)  —  not  Hu  else  not  H2. 


2 


NRL  REPORT  9017 


The  hypothesis  minimizing  the  error  probability  is  that  which  holds  true  for  each  of  these  tests.  These 
tests  are  applied  by  the  following  logic: 

If  test  {//0  and  //i)  is  true,  then 
If  test  [Hi  and  H2]  is  true,  then 
choose  hypothesis  H2 
else 

choose  hypothesis  Hy 
endif 
else 

If  test  [Hq  and  is  true,  then 
choose  hypothesis  H2 
else 

choose  hypothesis  H0. 
endif 
endif. 

CLASSICAL  METHOD 


The  classical  method  estimates  the  unknown  parameters  in  each  of  the  pdfs  and  then  applies  the 
minimum  probability  of  error  test.  We  shall  use  the  maximum  a  posteriori  (MAP)  estimate 

max  p(jr\ Hn\s)  —  ~s  for  Hn,  n  —  0, 1,2 . 

T 

For  each  hypothesis  Hn ,  the  unknown  parameters  are  estimated.  In  this  case,  the  unknown  parameters 
are  the  signal  levels  sy  and  s2y  and  the  relevant  pdfs  are 


U  .  (  I  u  \  1  -l/2(rj2  +  r2) 

H0:  p(rur2\H0)  =  —  e  1  2  , 


Hx:  p(rx,r2\Hx)  =  ~ 


1/2 1 (r j— s j)2  +  r2]  1  ~l/2[rj2  -f  (r2-52)2] 

26  +  ~2e 


and 


H2:  p(rur2\H2)  =  J_e  ,/2h  *,)2' + 

_  Lit 

The  estimates  tor  and  s2  that  maximize  these  pdfs  are: 


H0  :  (no  parameters  needed) , 

H i  :  s{  =  r{  and  s2  =  r2  , 
and 

H2  \  sx  =  ri  and  s2  =  r2  , 

where  and  rs  are  the  received  values  of  ry  and  r2,  respectively.  The  minimum  probability  of  error 
decision  rule  is  to  choose  the  hypothesis 


H0: 

1 

1 

-1/2  (r,*)2+  (r2*)2 

3 

2n 

e 

Hx: 

1 

1 

g-l/2(ri*)2  +  e-\l2(r^ 

3 

27T 

2 

H2: 

1 

3 

1 

277 

with  the  largest  value.  By  inspection,  H2  always  has  a  larger  probability  density  function,  hence  H2  is 
always  chosen  as  the  final  decision.  Since  H2  occurs  only  one  out  of  three  opportunities,  the  error 
probability  is  2/3. 
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KNOWN-SIGNAL  DETECTOR 

To  place  an  upper  bound  on  the  performance  that  any  method  could  yield,  the  minimum  probabil¬ 
ity  of  error  detector  was  designed  where  the  signal  strengths  were  used  in  the  design.  The  performance 
for  any  other  procedure  never  exceeds  the  performance  obtained  when  there  is  perfect  knowledge  of 
the  signal  strengths;  i.e.,  the  values  of  sj  and  s2  are  known. 

For  equally  likely  a  priori  probabilities,  P(H0 )  —  P(HX)  =  P(H2)  =  1/3. 

By  letting  Rx  =  e  l(  1  s,>  and  R2  =  e*2^2  1/2s2>,  the  tests  may  then  be  expressed  as 

R  j  +  R2 

H0  and  Hx\  1  <  - - - *  not  H0,  else  not  F/j , 

H0  and  H2  :  1  <  RiR2  — *  not  H0,  else  not  H2,  and 

R  +  i? 

Hi  and  H2  :  — — -  <  rxr2  — »  not  Hu  else  not  H2 . 


Note  that  R 1  and  R2  are  the  likelihood  ratios  of  (H0  and  //j)  and  (H0  and  //2),  respectively.  These 
tests  can  be  shown  graphically  on  a  /?,  and  R2  plot  where  each  (RUR2)  pair  lies  in  a  decision  region 
(labeled  for  H0,HU  or  H2).  The  boundaries  between  the  decision  regions  are  obtained  by  replacing  the 
inequalities  by  equalities.  All  decision  boundaries  are  shown  in  Fig.  1  where  parts  (a),  (b),  and  (c) 
show  the  boundary  of  each  test  individually,  and  (d)  shows  all  boundaries.  Note  that  the  H0 ,  H2  boun¬ 
dary  is  never  used.  Figure  2  shows  all  regions  and  boundaries  needed  to  make  a  decision. 

Table  1  shows  the  total  error  probability  for  known  signals  lying  between  -16  dB  and  +16  dB. 
Figure  3  shows  a  plot  taken  along  the  main  diagonal.  The  small  signal  asymptote  is  the  error  probabil¬ 
ity  that  is  obtained  when  nothing  is  known  about  the  signal;  for  equally  likely  a  priori  probabilities,  the 
small  signal  asymptote  error  probability  is  2/3.  The  error  probability  drops  to  0.02  when  the  signal  is  16 
dB  and  approaches  zero  for  large  signals. 

MINIMAX  CRITERION 

The  decision  rules  considered  contain  parameters  that  are  at  our  disposal.  To  select  design  param¬ 
eters  d,  a  minimax  test  is  conducted.  The  minimax  design  selects  the  design  parameters  d  by  perform¬ 
ing 

min  max  Q  (lactua,  ,d). 

d*D  s actual*  A 


The  selected  design  is  that  d  which  yields  this  minimax  value  for  Q  where  Q  is  a  performance  mea¬ 
sure,  vma/  is  the  actual  signal  value,  A  is  the  set  of  allowed  signal  vectors,  d  is  the  design  parameters 
at  our  disposal,  and  D  is  the  set  of  allowed  design  vectors. 


For  this  work,  the  performance  Q  is  the  difference  between  the  probability  of  error  using  the  sub¬ 
ject  design  and  the  probability  of  error  using  the  true  signal.  For  this  performance  measure,  Q  is  iden¬ 
tified  by  the  more  descriptive  notation  A P  (e). 


A  P  (e)  =  P 


error 


design  based  on]  _  p  [  1  design  based  on] 

assumed  signalsj  r  l  e  10  1  actual  signals  J 
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Ri  Ri 


(c)  Ht  vs  H2 


(d)  all  boundaries 


Fig.  1  —  "Known-signal"  decision  boundaries 
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Fig-  2  —  "Known-signal"  decision  regions 
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Table  1  —  P(e)  for  “known  signal” 
Si  (dB) 
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-14 

-12 

-10 

-8 

-6 

-4 

-2 

0 

2 

4 

6 

8 

10 

12 

14 

16 

16 

0.6367 

0.6305 

0.6222 

0.6162 

0.6017 

0.5933 

0.5753 

0.5573 

0.5290 

0.5012 

0.4658 

0.4302 

0.3993 

0.3700 

0.3498 

0.3387 

0.3347 

-14 

0.6300 

0.6297 

0.6213 

0.6103 

0.6070 

0,5897 

0.5747 

0.5572 

0.5283 

0.5017 

0.4673 

0.4305 

0.3998 

0.3712 

0.3500 

0.3388 

0.3350 

-12 

0.6220 

0.6167 

0.6195 

0.6078 

0.5970 

0.5862 

0.5720 

0.5510 

0.5253 

0.4975 

0.4665 

0.4285 

0.4000 

0.3688 

0.3498 

0.3385 

0.3347 

-10 

0.6150 

0.6088 

0.6045 

0.6043 

0.5948 

0.5782 

0.5658 

0.5442 

0.5268 

0.4997 

0.4663 

0.4268 

0.3980 

0.3687 

0.3508 

0.3392 

0.3360 

-8 

0.6037 

0.5993 

0.5942 

0.5880 

0.5822 

0.5688 

0.5555 

0.5358 

0.5208 

0.4927 

0.4653 

0.4250 

0.3982 

0.3658 

0.3485 

0.3378 

0.3347 

-6 

0.5935 

0.5852 

0.5820 

0.5773 

0.5752 

0.5633 

0.5457 

0.5328 

0.5102 

0.4790 

0.4510. 

0.4202 

0.3892 

0.3582 

0.3398 

0.3313 

0.3267 

-4 

0.5753 

0.5712 

0.5708 

0.5617 

0.5517 

0.5477 

0.5363 

0.5167 

0.4910 

0.4663 

0.4380 

0.4067 

0.3742 

0.3478 

0.3252 

0.3168 

0.3128 

3 

-2 

0.5553 

0.5557 

0.5510 

0.5423 

0.5350 

0.5282 

0.5190 

0.4930 

0,4728 

0.4488 

0.4212 

0.3930 

0.3567 

0.3292 

0.3087 

0.2988 

0.2958 

fN 

0 

0.5327 

0.5277 

0.5240 

0.5213 

0.5195 

0.5100 

0.4962 

0.4745 

0.4532 

0.4293 

0.3983 

0.3675 

0.3313 

0.3055 

0.2835 

0.2720 

0.2693 

2 

0.5048 

0.5045 

0.5030 

0.5028 

0.4915 

0.4858 

0.4712 

0.4532 

0.4280 

0.4017 

0.3738 

0.3343 

0.2988 

0.2675 

0.2465 

0.2365 

0.2338 

4 

0.4708 

0.4693 

0.4690 

0.4658 

0.4572 

0.4570 

0.4425 

0.4257 

0.3993 

0.3718 

0.3383 

0.2975 

0.2600 

0.2272 

0.2053 

0.1933 

0.1903 

6 

0.4378 

0.4360 

0.4372 

0.4382 

0.4302 

0.4283 

0.4185 

0.3973 

0.3665 

0.3345 

0.3000 

0.2547 

0.2160 

0.1787 

0.1575 

0.1462 

0.1423 

8 

0.3987 

0.3985 

0.3978 

0.3967 

0.3945 

0.3895 

0.3778 

0.3647 

0.3335 

0.3012 

0.2668 

0.2180 

0.1752 

0.1380 

0.1147 

0.1015 

0.0973 

10 

0.3703 

0  3700 

0.3707 

0.3688 

0.3630 

0.3605 

0.3507 

0.3340 

0.3050 

0.2745 

0.2325 

0.1853 

0.1395 

0.0992 

0.0743 

0.0588 

0.0540 

12 

0.3498 

0.3502 

0.3505 

0.3490 

0.3448 

0.3417 

0.3310 

0.3128 

0.2820 

0.2507 

0.2083 

0.1572 

0.1128 

0.0718 

0.0455 

0.0300 

0.0252 

14 

0.3393 

0.3393 

0.3397 

0.3368 

0.3350 

0.3323 

0.3238 

0.3018 

0.2708 

0.2393 

0.1970 

0.1443 

0.0990 

0.0577 

0.0302 

0.0150 

0.0100 

16 

0.3343 

0.3343 

0.3347 

0.3320 

0.3310 

0.3283 

0.3200 

0.2982 

0.2665 

0.2345 

0.1923 

0.1397 

0.0932 

0.0518 

0.2835 

0.0083 

0.0030 
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Fig.  3  —  Error  probability  for  "known-signal" 
design  (reference) 

ASSUMED  KNOWN-SIGNAL  DECISION  RULE 

Perfect  knowledge  of  Si  and  s2  combined  with  the  minimum  probability  of  error  criterion  leads  to 
the  rules  for  the  "known-signal"  detector.  By  assuming  values  for  s{  and  s2,  we  obtain  the  "assumed 
known-signal  decision  rules.  The  signal  parameters  in  R\  and  R2  are  the  design  parameters  at  our 
disposal.  To  help  pick  these  values,  two  criterions  are  used:  minimax  and  min-average.  The  min- 
average  lead  to  the  same  general  results  as  the  minimax  and  are  not  reported  here. 

The  problem  is  solved  by  considering  the  following  statements:  (1)  the  best  design  requires 
s2 d  =  si d\  (2)  the  location  of  the  actual  signals  yielding  the  worst  performance  is  at  either  s2  =  $i  or 
^2 max  and  $1 min  (or  S]min  and  $2  max);  and  (3)  the  best  design  occurs  at  the  intersection  of  the  limiting 
values  of  two  families  of  curves  associated  with  either  s2  =  sx  or  smax  and  smin.  We  consider  each  state¬ 
ment  independently  and  then  together. 

Table  2  contains  the  worst  (maximum)  A P(e)  for  the  design  signals  sld  and  s2d  ranging  from 
-16  dB  to  +16  dB  (each  entry  is  the  "max”  part  of  "minimax").  Thus,  each  entry  in  Table  2  is  the 
result  of  maximizing  81  A P(e)  values  for  a  table  total  of  6561  =  81  x  81  calculations.  This  table 
shows  the  best  design  to  have  s2d  =  sld  (this  is  the  "min"  part  of  "minimax").  This  table  places  the 
best  design  near  s2d  =  sid  =  8  dB.  Consequently,  we  have  demonstrated  the  first  statement  (1),  that 
the  best  design  lies  along  the  diagonal  s2  =  sj. 


Statement  (2),  which  claims  that  the  worst  performance  occurs  for  signals  of  s2  =  S]  or  when  one 
signal  is  a  maximum  and  the  other  is  a  minimum,  is  shown  in  Table  3.  Each  entry  in  Table  3  gives  the 
location  of  s,  and  s2  which  corresponds  to  the  worst  A P(e),  where  A P(e)  is  computed  for  all  values  of 
the  actual  signals  sj  and  s2.  The  entries  in  this  table  are  of  the  form  ( m,n )  where  m  and  n  =  signal 
value  (1  =  —16  dB,  2  =  —12  dB,...,  9  =  +16  dB)  and  m  O  sj.  For  example,  the  design  of 
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Table  2  —  Worst  A/^U)  for  Each  Design  Pair 
Sx  (dB) 


-16 

-12 

-8 

-4 

0 

4 

8 

12 

16 

-16 

0.4888 

0.4793 

0.4487 

0.4058 

0.3470 

0.2968 

0.2712 

0.2843 

0.4123 

-12 

0.4820 

0.4802 

0.4583 

0.4138 

0.3565 

0.2888 

0.2165 

0.2262 

0.3443 

-8 

0.4520 

0.4613 

0.4517 

0.4152 

0.3597 

0.2925 

0.2200 

0.1865 

0.3130 

& 

-4 

0.4042 

0.4165 

0.4143 

0.3940 

0.3393 

0.2762 

0.2052 

0.1918 

0.3167 

3 

(N 

0 

0.3505 

0.3565 

0.3610 

0  3445 

0.3017 

0.2465 

0.1820 

0.1957 

0.3182 

Co 

4 

0.3085 

0.2913 

0.2920 

0.2802 

0.2448 

0.1963 

0.1625 

0.1903 

0.3110 

8 

0.2820 

0.2242 

0.2240 

0.2127 

0.1837 

0.1565 

0.1490 

0.1772 

0.2933 

12 

0.2887 

0.2275 

0.1855 

0.1872 

0.1837 

0.1745 

0.1672 

0.1988 

0.2953 

16 

0.4038 

0.3372 

0.3030 

0.3068 

0.3042 

0.2978 

0.2888 

0.2890 

0.3958 

Table  3  —  Location  of  Worst  A Pr(e)  Actual 
Levels  for  “Assumed-Known  Signal”  Detector 
S}  (dB) 


-16  -12  -8 


0 


8 


12 


PQ 

3 

cs 

CO 


-16 

-12 

-8 

-4 

0 

4 

8 

12 

16 


9,9  9,9  9,9  9,9  9,9 


i 

9.9 

8.9 
8,9 

7.6 

8.7 


9,9 

7.6 

7.7 


9,9 

9.6 

9.7 


9,9 

9.6 

9.7 


9,9 

9.6 

9.7 


9.8 

9.9 


9,9 

9,9 

9,1 

9.5 

9.6 


9.8 

9.9 


\  \ 


9.9 

1.9 
1,9 
9,1 
9,6 


5,7 

5.7 
5,9 
5,9 
5,9 
5,9 
5,9 
6,6 

6.7 


16 

T8 

7,7 

7,9 

7.5 
7,9 
7,9 
7,9 

7.6 

8.7 


s2d  =  •Sid  =  12  dB  (located  near  the  lower  right-hand  corner  of  Table  3)  has  the  actual  signals  giving 
the  largest  A P(e)  of  (6,6)  or  Sj  =  s2  =  4  dB.  Two  points  can  be  made  Since  the  best  signal  design  is 
sid  =  Si,/,  we  need  consider  only  what  happens  there.  Two  actual  signal  locations  occur  on  the  main 
diagonal  at  (max,  max)  or  at  (min,  max).  Both  depend  on  the  signal  levels  used  in  the  computer  run. 
Observe  that,  except  for  the  design  at  (8  dB,  8  dB)  where  the  actual  signals  are  minimax,  all  other 
designs  along  the  main  diagonal  have  actual  signals  of  near  equal  strength  (s2  =  Si).  This  observation 
on  Table  3  verifies  statement  2. 


Statement  (3)  is  considered  in  three  parts:  (a)  determine  the  maximum  A/’fe)  over  all  possible 
actual  signals  s2  =  S]  for  each  design  signal  s2d  =  (b)  determine  the  maximum  AP(e)  for  all  actual 

signals  ($i  mm>  s2max)  or  (si  max,  s2 min)  for  all  design  signals  s2d  —  Sid\  and  (c)  determine  maximum 
A P(e)  from  (a)  and  (b). 

Working  on  part  (a)  first.  Fig.  4  shows  AP(e)  vs  s2d  —  for  various  values  of  s2  —  s2.  Figure 

4  indicates  that  for  any  signal  design,  A P(e)  is  nearly  the  same  for  all  large  actual  signals.  Further¬ 
more,  A P(e)  is  a  maximum  at  large  actual  signal  values  for  small  designs  (left  side  of  curve),  and 
A  Pie)  is  a  maximum  at  small  actual  signal  designs  when  the  design  signals  are  large.  The  envelope  of 
the  curves  defined  by  the  crosshatched  area  form  the  curve  of  maximum  A  P(e)  vs  signal  design 
s2d  =  sid-  Of  course,  the  minimax  solution  is  to  choose  the  signal  design  associated  with  the  minimum 
of  this  envelope  curve  that  occurs  at  sd2  =  sd j  ~  9  dB,  if  only  part  (a)  is  considered. 


9 


CHESTER  E.  FOX,  JR. 


Fig.  4  —  A P(e)  vs  design  signal  for  s2  —  S\ 
actual  signals  values,  "assumed  known-signal" 
design 


Part  (b)  of  statement  (3),  where  the  "assumed  known  signal"  detector  is  used  with  s2d  =  sXd  and 
the  actual  signals  take  their  minimum  and  maximum  values,  is  analyzed  by  computing  A P(e)  for 
smin  — ' '  0  and  smax  —  °o.  The  reference  "known-signal"  decision  rule  leads  to  deciding  H2  whenever  a 

large  signal  is  present  and  H0  otherwise.  Thus,  P(e  |  signal)  -y(0  +  l+0)«y.  Figure  5  is  a  plot 


of  this  condition. 


P(e)  has  little  variation  about  a  value  of 


^2d  ^1d  toB) 

Fig.  5  —  A  FCt)  vs  design  signal  for 
min/  max  actual  signal  values,  "assumed 
known-signal"  design 
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Finally,  part  (c)  of  statement  (3)  combines  the  results  of  the  maximum  error  A P(e)  vs  signal 
design  found  in  parts  (a)  and  (b).  The  combined  curves  from  (a)  and  (b)  are  shown  in  Fig.  6.  The 
best  signal  design  is  the  design  where  the  curve  of  the  maximum  values  of  A P(e)  is  a  minimum.  The 
best  "assumed  known-signal"  design  occurs  for  s2d  =  sid  equal  to  5  dB. 


Fig.  6  —  ^P(€)  vs  design  signal  for  best  s2 
*  $1  and  min/max  actual  signal  values— 
"assumed  known-signal"  design 


UNIFORMLY  DISTRIBUTED  SIGNAL  DECISION  RULE 

Another  approach  to  treating  the  unknown  parameter  problem  is  to  assign  a  probability  density 
function  to  these  parameters  and  then  to  compute  the  error  performance.  We  first  develop  the  test  for 
an  arbitrary  density  function,  then  specialize  to  the  uniform  density  case. 

=  Pdf  of  the  received  7,  conditioned  on  the  random 
parameter  7  taking  the  value  7  and  H„  being  true , 


P? (7)  =  pdf  of  7, 

^1„B(7|tf„)  =  fpr\?,Hn  (~r\s,H„)p?(7)d7. 


all's 


The  decision  rule  for  minimum  error  probability  becomes  (for  equal  P(H„ )): 

maxUlw  '  choose  Hn  . 

Hn  l  "  1 

si  and  s2  are  taken  to  be  independent  random  quantities:  pu(si,s2)  =  Ps^sjp^isi).  Assume 
si  and  s2  are  uniformly  distributed  between  s,  and  su : 

|l/(s„  ~  si)  ,  Si  <  s  <  su 
[  0  ,  elsewhere 


Ps(s)  = 


Pr\7,Hn  =  T~  e 


ri  + 'l 


2l T 
1  1 


('T-*l>2+'22  /■?  +  (r2  -  ij)2 

2  +  ±  —  e  2 - 

1  2  2-tt  2  2 tt 


( r  I  e 


C/j-i,)2  +  (r2  -  s2)2 
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The  indicated  integration  can  be  performed  by  evaluating  two  types  of  integrals. 


u 

'S 


1  “T  1  j 

e  1  - ds  = 


(2n)l/2  su-s, 

I 

(r — 


1  "T 

- e 


(2tt)1/2 


e  - ds 


Su  S[ 

(r-s)2 


(2t r)1/2 

Su-S,  JS/  (2ir)l/2 

=  — - — f/*(su-r)  -  PCs,-/-)] 
s„-s,  L  J 


ds 


X 

where  P(x)  =  J 


1  ~~T 


L  (2tt)  1/2 


e  L  dv  . 


The  conditional  pdfs  are  then: 


PAhJsW  =  1 


c" 2  lp(s-~ri) '  p<s,',,)] 

^-■yg  2  [p(s„-r2)  -  P(s/-r2)|, 


1  1 


and 


Define 


2  (2tt)1/2  (su-s,) 

=  2  \2  [p(s„-r2)  -  />(s/-r2)j[f>(su-r1)  -  /,(s,-r1)j . 


_  r  2 

W(r)  =  ^-e+~\ P{su-r)  -  P(s,-r)l  , 
su-sl  L  1 

Wx  =  W{rx) , 

and 

W2  -  W/(r2)  . 

Note  that  and  W2  are  likelihood  ratios  of  Hx  and  H2  respectively.  The  pdfs  become: 

^Fltf0(r  l^o) 

Pr]Hx(r\H\) 

Pr\H2(7\H2) 


'  \  '  '2 
2 


2tt 


2tt 


in, 


r  2  _l  -  2 

rl  +r2 


^,+  1^2 


,  and 


r}  +  'j 

-j^e~  ’  \W,W2\. 
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The  tests  are  expressed  in  terms  of  Wx  and  W2  by 

H0  Hx  H2 

I  I  I 

max  [1,  M2(Wx+W2),  Wx+W2]  —  choose  Hn  . 

Hn 

This  is  of  the  same  form  as  for  the  known-signal  case  where  {Wn}  replaces  {/?„}.  Consequently,  the 
decision  boundaries  are  already  known  and  are  shown  in  Fig.  7.  Thus,  if  no  unknown  parameters  are 
present  and  the  signal  and/or  noise  are  independent  of  each  other,  the  decision  boundaries  can  be  writ¬ 
ten  as  in  Fig.  7  where  the  axes  are  labeled  "likelihood  ratio,"  Fig.  7  holds  for  all  likelihood  ratios. 


w, 


Fig.  7  —  "Uniformly  distributed  signals" 
decision  regions 


The  signal  location  considered  is  a  square  region,  centered  at  the  origin  of  the  signal  space.  It  is 
defined  by  sL  =  —Sy,  where  sL  =  lower  limit  and  Sy  =  upper  limit  of  signals  as  shown  in  Fig.  8.  The 
performance  measure  A P(e)  is  computed,  and  the  value  and  location  of  A P(e)MAX  are  given  in  Table 
4.  From  Table  4,  the  best  design  occurs  around  Sy  =  14  dB.  The  maximum  values  of  the  actual 
signals  shown  in  Table  4  are  plotted  in  Fig.  9  for  each  design  sv  near  the  solution,  and  the  true 
minimax  solution  is  =  13  dB.  This  information  is  shown  graphically  to  allow  interpolation  in  finding 
the  minimax  solution.  Table  5  shows  A P(e)  vs  all  actual  signals  for  the  best  design  Sy  =  13  dB. 
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Table  4  —  Value  and  Location  of  Largest  AP(e) 
“Uniformly  Distributed”  Detector 


(dB) 

A P{e) 

Location  of  target 

8 

0.367 

Maximum/maximum 

10 

0.240 

Maximum/maximum 

12 

0.175 

Maximum/maximum 

14 

0.165 

Maximum/minimum 

16 

0.173 

Maximum/interior 

18 

0.183 

Maximum/interior 

20 

0.183 

Interior/interior 

22 

0.183 

Interior/interior 

Fig.  9  —  Determining  best  "uniformly  distributed 
signals"  design 
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Table  5  —  AP(e)  for  “Uniformly  Distributed  Signals”  Detector 
(at  best:  Sv  =  —SL  =  13  dB) 


-16 

-14 

-12 

-10 

-8 

-6 

-4 

-2 
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4 

6 

8 

10 

12 

14 

16 

0.0292 

0.0357 

0.0440 

0  0472 

0.0603 

0.0672 

0.0807 

0.0927 

0.1117 

0.1222 

0.1305 

0.1383 

0.1288 

0.1307 

0.1338 

0.1415 

0.1453 

0.0358 

0.0362 

0.0435 

0.0530 

0.0550 

0.0705 

0.0800 

0.0918 

0.1113 

0.1207 

0.1287 

0.1377 

0.1253 

0.1275 

0.1323 

0.1380 

0.1417 

0.0430 

0.0483 

0.0445 

0.0547 

0.0645 

0.0732 

0.0828 

0.0958 

0.1135 

0.1227 

0.1277 

0.1352 

0.1237 

0.1273 

0.1297 

0.1362 

0.1402 

9.0497 

0.0552 

0.0588 

0,0578 

0.0663 

0.0802 

0.0883 

0.1027 

0.1107 

0.1212 

0.1282 

0  1352 

0.1237 

0.1215 

0.1220 

0.1305 

0.1338 

0.0585 

0.0622 

0.0673 

0.0727 

0.0768 

0.0873 

0.0962 

0.1085 

0.1128 

0.1220 

0.1227 

0.1345 

0.1213 

0.1192 

0.1215 

0.1280 

0.1310 

0.0655 

0.0728 

0.0767 

0.0802 

0.0810 

0.0890 

0.1015 

0.1060 

0.1173 

0.1295 

0.1298 

0.1308 

0.1172 

0.1180 

0.1173 

0.1220 

0.1268 

0.0813 

0.0848 

0.0848 

0.0938 

0.1005 

0.1013 

0.1075 

0.1172 

0.1322 

0.1368 

0.1375 

0.1330 

0.1212 

0.1140 

0.1173 

0.1222 

0.1260 

0.0933 

0.0927 

0.0977 

0. 1072 

0.1132 

0.1178 

0.1185 

0.1328 

0.1417 

0.1443 

0.14i7 

0.1340 

0.1277 

0.1160 

0.1185 

0.1238 

0.1270 

0.1057 

0.1107 

0.1137 

0.1165 

0.1163 

0.1240 

0.1280 

0.1380 

0.1457 

0.1482 

0.1432 

0.1368 

0.1220 

0.1107 

0.1163 

0.1233 

0.1262 

0.1188 

0.1182 

0.1197 

0.1180 

0.1290 

0.1282 

0.1333 

0.1420 

0.1512 

0.1532 

0.1380 

0.1340 

0.1148 

0.1070 

0.1057 

0.1132 

0.1160 

0.1280 

0.1292 

0  1302 

0.1322 

0.1365 

0.1308 

0.1372 

0.1430 

0.1473 

0.1465 

0.1257 

0.1173 

0.1015 

0.0895 

0.0930 

0.1018 

0.1043 

0.1308 

0.1310 

0.1278 

0.1250 

0.1303 

0.1263 

0.1250 

0.1292 

0.1360 

0.1293 

0.1082 

0.1013 

0.0840 

0.0822 

0.0853 

0.0938 

0.0975 

0  1308 

0.1270 

0.1250 

0.1230 

0.1195 

0.1177 

0.1165 

0.1150 

0.1122 

0.1058 

0.0848 

0.0805 

0.0670 

0.0610 

0.0680 

0.0783 

0.0830 

0.1247 

0.1240 

0.1240 

0.1207 

0.1202 

0.1152 

0.1108 

0.1092 

0.1032 

0.0970 

0.0803 

0.0720 

0.0608 

0.0637 

0.0748 

0.0872 

0.0925 

0.1308 

0.1295 

0.1282 

0.1258 

0.1243 

0.1207 

0.1135 

0.1107 

0.1112 

0.1035 

0.0855 

0.0838 

0.0735 

0.0787 

0.0910 

0.1040 

0.1090 

0.1372 

0.1355 

0.1348 

0  1325 

0.1283 

0.1238 

0.1148 

0.1172 

0.1172 

0.1110 

0.0913 

0.0925 

0.0842 

0.0897 

0.1035 

0.1165 

0.1217 

0  1417 

0.1393 

0.1393 

0.1368 

0.1322 

0.1277 

0.1188 

0.1210 

0.1217 

0.1153 

0.0962 

0.0963 

0.0892 

0.0953 

0.1098 

0.1230 

0.1285 
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SEQUENTIALLY  APPLIED  NEYMAN-PEARSON  DECISION  RULES 

The  lack  of  knowledge  about  the  signal  levels  Si  and  s2  suggest  formulating  a  test  that  does  not 
use  these  signal  levels.  The  Neyman-Pearson  test  comes  close  to  meeting  this  condition.  This  test  sets 
the  threshold  when  the  signal  is  absent  so  that  a  given  probability  of  false  alarm  ( Pfa )  occurs.  The 
probability  of  missed  detection  is  computed  from  knowing  this  threshold  and  the  signal-to-noise  ratio. 

Three  hypotheses,  H0,  Hu  and  H2  are  present  in  this  problem  while  the  standard  Neyman- 
Pearson  technique  applies  to  a  binary  problem.  To  apply  the  Neyman-Pearson  technique,  the  problem 
is  expressed  as  a  series  of  binary  tests  and  the  Neyman-Pearson  technique  is  applied  to  each  one  in 
sequence.  The  Neyman-Pearson  technique’s  parameter  Pfa  sets  a  threshold  for  a  single  signal.  The 
symmetry  of  the  problem  leads  to  applying  the  same  Pfa  for  both  sx  and  s2.  Then,  both  rx  and  r2  are 
tested  to  see  if  either  sx  or  s2  are  present  by  comparing  rx  and  r2  to  this  threshold.  If  both  do  not  cross 
the  threshold,  then  H0  is  declared  and  the  test  is  stopped.  An  additional  pair  of  tests  is  made  when  H0 
is  not  declared.  The  number  of  signals  declared  present  determines  which  Hn  is  chosen. 

The  threshold  for  the  test  uses  the  noise-only  hypothesis;  thus  pdf  can  be  written 


oo 


Figure  10  shows  r0  vs  Pfa  for  Gaussian  noise,  and  Fig.  11  shows  the  decision  regions.  The 
combined  test  applied  to  the  received  signal  7*  is  then: 

If:  | ri  |  <  r0,  and  \r*2  \  <  r0 

Then:  declare  H0 

Else: 

If:  \r[\  >  t o,  and  \r2  \  >  r0 
Then:  declare  H2 
Else:  declare  Hy 
End. 


Fig.  10  —  Threshold  t 
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ACTUAL  SIGNALS  (S^S^  (dB) 
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r2 


Fig.  11  —  Neyman-Pearson  decision  region 


Figure  12  is  a  plot  of  P(e)  vs  signal  level  ( s2  =  Si)  for  various  Pfa-  The  error  probability 
approaches  a  limit  slightly  less  than  Pfa  as  the  signal  strength  increases.  Since  the  "known  signal" 
detector  has  Pfa-  0  for  large  signals,  a  design  using  small  Pfa  seems  desirable.  Figure  12  shows  that 
the  small  signal  performance  is  poor  for  small  Pfa  designs  and  large  signal  performance  is  poor  for  large 
Pfa  designs.  A  compromise  must  be  made  to  obtain  good  performance  at  all  signal  levels. 
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A  particular  design  value  for  the  probability  of  false  alarm  is  determined  by  using  a  minimax  cri¬ 
teria.  In  this  case,  the  worst  differential  error  APCe)  over  all  actual  signals  is  plotted  vs  Pfa  (Fig.  13). 
The  best  design  for  Pfa  is  Pfa  =  0.08,  because  the  worst  A P{e)  is  a  minimum  at  this  point.  The  actual 
signal  levels  that  yield  the  worst  AP(e)  are  noted  on  the  figure.  The  solid  line  indicates  the  worst 
AP(e)  is  occurring  where  s2  =  5!  for  these  various  Pfa.  The  dotted  line  indicates  the  worst  A P(e) 
occurs  for  s2  s*  S\. 


Fig.  13  —  A  P  (  error)  vs  Pfa  —  Neyman-Pearson 
uncorrelated  noise 


The  remainder  of  this  report  investigates  the  effect  of  noise  correlation  on  the  performance  of 
some  Neyman-Pearson  detectors. 

CORRELATED  NOISE 


Decision  making  in  correlated  noise  is  made  by  generalizing  the  Neyman-Pearson  work.  The 
hypothesis  of  no  signals  being  present,  //0,  is  tested  by  decorrelating  the  jointly  Gaussian  noise  and 
applying  a  Neyman-Pearson  Pfa  test  to  both  rx  and  r2 .  Jointly  Gaussian  random  variables  can  be  made 
independent  of  each  other  by  applying  the  proper  linear  transformation.  The  parameter  9  in  the 
transformation  is  selected  so  that  the  transformed  random  variables  are  independent  of  each  other. 


The  pdf  of  the  noise  (for  o-2  =  a\  =  1)  is 
p(nu  n2) 


1 


n  i  —  2pn  jn2  +  n2 


27r(l-p2)1/2 


2(1 


The  transformation  used  is: 

m\  “  ri\  cos  9  +  n2  sin  9 
m2  =  n\  sin  9  +  n2  cos  9 . 

2p(T\(J2 


In  this  case,  cr2  —  o-j  so  that  9  =  and  sin  9  =  cos  9  =  1/V2  .  The  uncorrelated  Gaussian  density  of 
the  new  variables  is  given  by 


The  noise  is  decorrelated  by  0  =  y  tan  1 


:(m)  = 


1 


<*mx  “  1  +  P  and  o-; 


2tt<7 
1  -p. 


where 
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The  mx  and  m2  thresholds  are  obtained  by  causing  the  threshold  r0  to  apply  to  meet  the  design 
parameter  PjQ  with  a  —  1  and  then  adjusting  this  threshold  for  a  ^  1: 


(2tt)1/2 


r-lttn2 


dn  . 


For  nonunity  standard  deviation  x  =  n  cr, 

-  /< 


l 


(<rT0)  (2tt)1/2o- 
ti  =  Cm,  To  =  Vi+PTo ,  and 


,To 


PTO- 


The  test  for  H0  is 

If:  I?!*  |  <  T]  and  |r2 1  <  r2 

Then:  declare  H0, 

Else:  test  for  Hx  or  H2, 

End. 

where  r[  and  r2  are  the  transformed  received  signals  r\  and  r'2. 


If  H0  is  declared  true,  then  the  test  is  completed;  if  H0  is  not  declared,  the  test  for  Hx  and  H2  is 
conducted  by  using  two  additional  tests.  The  first  test  is  to  determine  if  S\  is  present  conditioned  on  s2 
being  present,  and  the  second  tests  for  s2  given  sj.  To  conduct  these  tests,  two  methods  are  investi¬ 
gated.  The  first  test  is  the  same  as  the  test  used  for  uncorrelated  noise,  and  the  second  is  new.  The 
first  method  ignores  correlation  in  all  tests  made;  its  development  has  already  been  discussed.  The 
second  method  conducts  tests  based  on  conditional  densities.  The  densities  are  conditioned  on  one  sig¬ 
nal  being  zero  and  the  other  being  an  estimate.  The  estimate  is  "most  likely." 


The  results  are  obtained  by  using  the  Neyman-Pearson  method  developed  in  the  previous  section 
for  Pfa  =  O.OOOh,  0.001,  0.01,  0.1,  and  0.25,  and  for  noise  correlation  coefficient  p  =  0.99.  The  other 
two  methods  considered  are  similarly  plotted.  The  following  points  can  be  made  from  Fig.  14. 

•  The  performance  of  small  signals  approaches  the  classical  result  of  P(e)  =  2/3,  which  is  reason¬ 
able  since  no  procedure  can  do  better  for  zero-strength  signals. 

•  As  the  signal  increases,  the  performance  breaks  away  from  the  classical  result.  Consider,  for 
example,  the  signal  levels  encountered  for  P(e)  =  0.6  (90%  of  the  classical  value).  The  signal  at 
Pfa  =  0.0001  has  to  be  15  dB  stronger  than  the  Pfa  =  0.25  value.  The  15  dB  signal  difference 
decreases  to  7  dB  when  P(e)  =  0.3  due  to  the  greater  slope  of  the  curves  at  small  Pfa  values. 

•  Signals  lying  between  — 10  dB  and  +7  dB  have  error  probabilities  that  are  better  for  large  Pfa 
values. 


•  The  large  signal  performance  gets  poorer  for  larger  Pfa  values.  For  example,  the  pfa  =  0.25 
curve  never  gets  below  0.165.  This  poor  performance  is  due  to  nonzero  P(e)  for  H0  and  Hx. 

A  small  Pfa  design  gives  poor  performance  at  moderate  signals  but  good  performance  at  large  sig¬ 
nals,  and  a  large  P fa  design  gives  poor  performance  at  large  signals  but  good  performance  at  midlevel 
signals;  a  nominal  value  of  pfa  =  0.1  was  chosen  for  further  analysis. 

Figure  15  is  a  plot  of  P(e)  vs  actual  signal  strength  (s2  =  S[)  for  Pfa  =  0.1  and  p  =  0.9,  0.99, 
and  0.999.  These  p  values  are  both  smaller  and  larger  than  the  nominal  p  used  in  the  curves  of  Fig. 
14.  Figure  15  shows  that  there  is  only  slight  difference  for  all  values  of  p,  the  most  obvious  being  the 
strong  signal  performance.  Here,  the  performance  at  the  smaller  p  values  is  best  and  is  —35%  lower 
than  the  0.075  error  performance  at  p  =  0.999. 
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Fig.  IS  —  Ignore  correlation—  Pc  =  0.1 
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Most  Likely  Estimate  (Correlated  Noise) 


Conducting  a  Neyman-Pearson  test  for  the  presence  of  a  signal  requires  estimating  unknown 
parameters  and  integrating  the  pdf,  with  this  signal  not  present,  over  a  region  set  by  Pfa  considerations. 
The  second  method  of  accounting  for  correlated  noise  estimates  the  unknown  signal  s2  in 
pirx\r2  =  r2,  $i  =  0,  s2)  by  maximizing  the  joint  pdf  p(rur2). 


p(rur2) 


1  ~  2(1  2)i/2  [(fl "  s,)2  _  2p(r>  “  s'Hr2  ~  S2>  +  (r2  -  s2)2) 

2tt(1  —  p 2) 


where  rx  and  r2  equal  their  received  values  and  sj  =  0. 

ds2 


we  get  s2  =  r2  —  pr\  and 


By  setting 
=  0, 


p(r,|r2)  = 


Pirufj) 

p(r2) 


(ri  ~p2,,i*)2 

1  „  2(l-p2)>/2 

(2tt)1/2(1-P2)1/2 


-  N  ( p2r[ ,  (r2=  1  -p2). 


For  a  Gaussian  random  variable  rx,  the  desired  threshold  r,  centered  about  the  mean  p2r\,  is 
r  =  Vl— p2r o  where  t0  is  the  threshold  for  p  =  0.  The  random  variable  (rx  -  p2r\ )  is  a  Gaussian  ran¬ 
dom  variable  with  zero  mean  and  variance  =  1  -  p2.  The  rule  is  to  declare  sx  absent  if  \rx-p2r{  \  <  t. 
Since  rx  =  r{  when  the  test  is  applied, 

I/-!*  1(1  —  p2)  <  r  — *  Sj  absent 


\ri 


i  I  < 


TO 


(l-p2)1/2 


absent,  else  sx  declared  present. 


A  similar  test  holds  for  declaring  s2  present  or  absent.  The  declaration  of  Hx  or  H2  is  made  as  before, 
Si  and  s2  present  — 1 ►  H2.  otherwise  Hx. 

The  error  performance  obtained  by  estimating  the  unknown  signals  by  maximizing  the  joint  den¬ 
sity  function  ("most  likely"  method)  is  given  in  Figs.  16  and  17.  Figure  16  is  a  plot  of  Pie)  vs  actual 
signal  strength  (s2  =  s^  for  p  =  0.99  and  values  of  Pfa  from  0.0001  to  0.25.  This  set  of  curves  shows 
a  plateau  not  found  for  the  other  estimation  methods.  The  curve  of  P(e)  vs  s2  (^Sj)  decreases  from 
the  classical  limit  of  2/3  to  a  level  that  depends  on  Pfa  (signal  levels  from  0  to  15  dB).  For  very  weak 
signals,  larger  values  of  pfa  give  better  small  signal  performance.  The  plateau  extends  from  signal 

values  of - 5  dB  to  +25  dB,  the  actual  limits  depend  on  Pfa-  For  strong  signals,  the  error  P(e)  is 

smallest  for  the  smallest  Pfa.  The  large  signal  error  performance  is  determined  only  by  P(e\H0)  (since 
P (c  I H \)  and  JP(e|//2)  —  0),  and  is  given  by 

Pie)  =  PiH0)Pie\H0)  =  |[l  -  i\-Pfa)2  ] . 

For  Pfa  =  0.25,  this  equation  gives  P(e)  —  0  146,  which  agrees  with  the  value  computed.  This  does 
not  verify  the  accuracy  of  the  Monte  Carlo  method  used  because  the  Monte  Carlo  method  gives  exact 
values  for  PielH^)  and  P(e|//2)(=  0)  that  are  accurate  to  an  infinite  number  of  places.  An  exact 
match  would  not  occur  for  smaller  signals.  There  is  no  overall  better  design  because  the  Pfa  values 
giving  the  lowest  P(e)  changes  from  (starting  at  small  signals  and  progressing  to  larger  signals): 

a  max  *  Pfamin  *  ^/amax  *  ^/omiir 
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Fig.  16  —  "Most  likely”  signal  estimation,  p  —  0.99 


Fig.  17  —  "Most  likely"  signal  estimation,  Pfa  =  0.1 
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Figure  17  plots  P(e)  vs  actual  signal  (s2  =  sx)  for  Pfa  =  0.1  and  p  =  0.9,  0.99  and  0.999  for  the 
"most  likely"  signal  estimation  method.  These  curves  show  that  the  plateau  length  increases  with 
increasing  p.  The  p  =  0.9  case  almost  causes  all  indications  of  this  plateau  to  disappear.  The  drop  in 
P(e)  of  the  small  signal  side  of  the  plateau  is  caused  by  PielH])  going  from  a  value  near  one  to  zero, 
while  the  drop  for  signals  to  the  right  of  the  plateau  drop  because  the  conditional  error  probability 
P(e\H2)  goes  from  one  to  zero.  The  remaining  strong  signal  P(e)  is  determined  by  P(e\H0).  Large  p 
values  markedly  improve  the  small  signal  performance  but  also  markedly  reduce  the  moderate-to-large 
signal  performance.  For  large  signals,  large  p  gives  the  best  performance. 

Error  performance  of  the  two  methods  are  compared  in  Fig.  18,  a  plot  of  P(e)  vs  actual  signal 
( s2  =  Sj)  and  for  p  =  0.99  and  Pfa  =  0.1.  Small  signal  error  performance  is  best  for  the  "most  likely" 
estimation  method  and  continues  to  be  best  until  the  signals  reach  +5  dB.  Then  the  "ignore 
correlation"  method  does  markedly  better  until  the  signals  reach  +25  dB  and  remains  marginally  better 
for  larger  signals.  All  methods  have  signal  ranges  where  they  perform  noticeably  worse  than  the  best, 
thus  no  method  is  chosen  "best."  If  forced  to  choose,  the  choice  would  be  for  the  method  that  ignores 
correlation.  This  is  because  it  has  fractionally  less  degradation  where  it  is  not  the  best  compared  to  the 
"most  likely"  method. 


Fig.  18  —  Comparison— correlated  noise— p  =  0.99 
and  Pfa  -0.1 

In  addition  to  investigating  the  results  of  applying  these  methods,  the  effect  of  the  reference 
"known  signal"  detector  is  further  considered.  Figure  19  is  a  plot  of  P(e)  vs  signal  strength  (s2  =  $i) 
for  p  =  0.,  0.9,  0.99,  0.999,  and  0.9999.  As  the  noise  becomes  more  correlated  (p  — >1)  the  perfor¬ 
mance  gets  better,  primarily  for  smaller  signals.  This  is  because  the  noise  becomes  less  uncertain.  All 
curves  join  the  lower  curve,  thus  at  larger  signals  the  performance  for  all  p  is  almost  the  same.  At  very 
small  signals,  the  performance  is  that  of  the  "best"  a  priori  performance  (where  the  received  signals  are 
not  considered  in  making  a  decision).  Between  these  extremes,  the  p-dependency  can  be  seen.  In  the 
limit  p  —1,  the  noise  voltages  are  equal;  thus  under  H0,  no  errors  are  made  if  the  rule  "Declare  H0 
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ACTUAL  SIGNALS  (S2  -  (dB) 


Fig.  19  —  Effects  of  correlation  and  known  signals 


present  if  and  only  if  r\  =  r\"  is  used.  For  very  small  signals,  no  noticeable  difference  is  present 
between  Hx  and  H2  so  an  error  is  made  half  of  the  time,  i.e.,  P(e\Hx)  +  P(e\H2)  =  1/3.  Hence, 
Pie)  =  1/3.  The  general  shape  of  the  performance  curves  are  about  the  same  for  all  p,  and  the  curves 
are  shifted  —10  dB  for  each  "9"  change  in  p  (or  for  each  10  dB  reduction  in  (1 — p)) . 

COMPARISONS 

The  error  probability  of  the  "best"  of  each  decision  rule  considered  for  the  uncorrelated  cases  are 
plotted  in  Fig.  20.  The  known  signal  case  is  a  lower  bound  (as  expected).  The  best  "assumed  known 
signal"  design  is  for  s2d  =  S\d  =  8  dB,  the  "uniformly  distributed"  design  is  best  for  su  =  13  dB,  and 
the  Neyman-Pearson  design  is  best  for  Pfa  =  0  .08;  each  gives  almost  the  minimum  A  Pie)  within  that 
particular  family  of  designs. 

For  small  signals,  the  "best"  (lowest)  error  performance  is  obtained  for  the  "assumed  known  sig¬ 
nal"  detector  method.  The  uniformly  distributed  Neyman-Pearson  are  always  worse  than  the  "assumed 
known  signal"  case  until  the  signal  levels  are  near  10  dB  where  (by  coincidence)  they  all  come  near 
each  other.  For  larger  signals,  the  lowest  Pie)  design  becomes  the  Neyman-Pearson.  The  "uniformly 
distributed"  detector  is  worse  than  the  "assumed  known  signal"  detector  except  for  large  signals.  No 
rule  is  uniformly  better  [2,  p.  796]  than  others,  so  choosing  the  best  rule  requires  judging  the  advan¬ 
tages  and  the  disadvantages  of  each.  My  choice  of  those  shown  is  the  "assumed  known  signal"  because 
it  is  close  to  the  "known  signal"  detector  error  probability  results  for  small  signals. 

Correlated  noise  introduces  another  piece  of  information  (correlation  coefficient)  into  the  prob¬ 
lem.  The  Neyman-Pearson  tests  required  an  estimate  of  the  (unknown)  signals,  not  set  equal  to  zero 
as  before,  in  the  conditional  pdf.  The  selected  method  is  "ignore  correlation." 

CONCLUSIONS 

The  error  performance  in  determining  the  number  of  signals  present  when  each  signal  (if  present) 
combines  linearly  with  Gaussian  noise  and  with  only  a  single  look-per-signal  (if  available)  is  compared 
and  evaluated  numerically;  the  one  giving  the  lowest  error  probability  (or  close,  since  none  were 
uniformly  best)  is  selected.  The  classical  method  estimates  any  needed  unknown  parameters  and  places 
their  estimates  in  the  probability  density  functions.  The  hypothesis  with  the  largest  probability  density 
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Fig.  20  —  Comparison  of  detection  schemes 
(equal  signal  energy) 


function  is  the  one  chosen.  The  error  performance  is  poor,  being  2/3  for  all  signals.  All  alternate 
detection  schemes  considered  (assuming  known  signals,  uniformly  distributed  signals,  and  Neyman- 
Pearson)  offer  improvements  over  the  classical  method.  The  effect  of  using  a  limited  signal  range  to 
select  the  best  design  of  any  one  criterion  was  shown  to  be  minimal.  This  was  true  for  many  of  the 
tests  studied. 
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